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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including tine fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
2/13/2009 has been entered. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1 and 9 have been considered but 
are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-15, 19 and 21 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Zweig (U.S. Patent No. 6,658,325 B2) in view of Yamada et al. 
(hereinafter Yamada)(U.S. Pub. No. 2002/0081937 Al ), and further in view of Boudreau 
et al. (hereinafter Boudreau)(U.S. Pub. No. 2004/0117858). 

Regarding claim 1 , Zweig teaches as follows: 
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a multi-dimensional robotic web browser (computerized mobile robot with an 
onboard Internet web server, see, e.g., abstract, lines 1-7), comprising: 

means for downloading high level program instructions transmitted over 
an electronic network (the robot receives its most general highest level commands from 
the remote Internet link, see, e.g., col. 6, lines 65-67), wherein said high level program 
instructions include synchronized multimedia integration language (robot control 
instructions may be written in a wide variety of formats and language such as XML 
scripts, PERL script, JAVA applets, and the like, see, e.g., col. 7, lines 31-40, wherein 
the SMIL is similar to an HTML-like language is written in XML, see, e.g., W3C SMIL 1 .0 
Specification); and 

means for rendering said downloaded high level program instructions (control 
instructions) transmitted over said electronic network (lnternet)(interpreter program, 
RCS software 16 in figure 2, interprets and compiles various control instructions, see, 
e.g., col. 10, lines 10-12), such that when at least a portion of said downloaded 
instructions are rendered (interpret and modify these top-level commands in a quick and 
real-time manner, see, e.g., col. 7, lines 1-6), direct said robotic web browser to one of 
move in three dimensions (a robot may be given a remote command over the Internet to 
move forward a number of feet, see, e.g., col. 7, lines 7-8). 

Zweig does not teach the web browser included in the robot but teaches a 
computerized mobile robot with an onboard internet web server (see, e.g., abstract, 
lines 1-2). 
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It would have been obvious for one of ordinary skill in the art at the tinne of the 
invention to modify Zweig to alter the functionality of the robot from a web server to a 
web browser in order to manage a plurality of robotic web browsers with one dedicated 
web server and also to reduce the cost of making the robot. 

Yamada teaches as follows: 

a robot including a web browser (connecting the electronic toy (equivalent to 
applicant's robot) to a network through a connection means includes a personal 
computer, see, e.g., page 4, paragraph [0067]-[0071], connecting the communication 
Interface of the robot with the personal computer connected to the Internet, see, e.g., 
page 1 5, paragraph [0287]-[0288]); 

direct said robotic web browser to move in three dimensions (movement 
mechanism, see, e.g., page 1, paragraph [0012] and page 2, paragraph [0026]), play 
back an audio stream (sound data Is downloaded with the connection means, see, e.g., 
page 4, paragraph [0067], outputting the downloaded sound data as a voice by the 
vocalization means, see, e.g., page 2, paragraph [0053]), and play back a video stream 
(display unit displays information, see, e.g., page 9, paragraph [0219], attached sound 
file is played, see, e.g., page 17, paragraph [0314]); and 

the robot Is configured to move synchronously with content being rendered by a 
rendering device other than the robot (the electronic toy controlled so as to react to 
external information, see, e.g., page 2, paragraph [0032], making the robot move in 
correspondence with music or sound collected by a microphone, see, e.g., page 19, 
paragraph [0330]-[0331]). 
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It would have been obvious for one of ordinary skill in the art at the time of the 
invention to modify Zweig to include multi functional robot as taught by Yamada in order 
to be utilized the robot as an adult toy performing various operations. 

Since Yamada teaches a display unit and the capability to run the downloaded 
sound file, it would have been obvious for one of ordinary skill in the art at the time of 
the invention to modify Yamada to include video stream play back function. 

Zweig does not teach of producing behaviors and interactions based on user 
preferences stored in a memory of the robot. 

Yamada teaches as follows: 

an emotion parameter (equivalent to applicant's user preference) is set based on 
the specific person (an emotion parameter is included in the control parameter, and the 
emotion parameter is represented as the biorhythm of a specific person, see, e.g., page 
3, paragraph [0045]); 

producing behaviors and interactions based on the emotion parameter (control 
unit selects the information to be externally displayed and/or selects the sound to be 
externally output based on the emotion parameter, see, e.g., page 3, paragraph [0049]); 
and 

the electronic toy comprises a connection means for connecting the electronic 
toy to a network, and wherein at least one of the words and sound data is downloaded 
to the storage means (equivalent to applicant's robot memory) from a server device 
connected to the network (see, e.g., page 4, paragraph [0067]). 
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It would have been obvious for one of ordinary skill in the art at the time of the 
invention to modify the emotion parameter to the user preference in order to display the 
received instruction or data in terms of the user's emotional status was previously 
stored. 

Therefore, Yamada teaches of rendering produce behaviors and interactions 
based on user preferences stored in a memory of the robot. 

It would have been obvious for one of ordinary skill in the art at the time of the 
invention to modify Zweig to include the emotion parameter as taught by Yamada in 
order to select different outputs means for the downloaded data through the network 
based on the emotion parameter was set based on a specific person. 

Zweig in view of Yamada teach the multidimensional robot produces behaviors 
based on a rendering device as presented above. 

Zweig in view of Yamada do not teach that the rendering device is a television 
and producing behaviors and interactions based on a television show. 

Boudreau teaches as follows: 

a multi-media system includes functionality that provides for the download of 
content, including video. Audio, and/or data corresponding to television show episodes, 
that is related to the content presented on a television (the television is a well-known 
rendering device), and its corresponding presentation at an external device (equivalent 
to applicant's robot)(see, e.g., page 1, paragraph [0014]); 
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the presentation of content displayed on the television set can be synchronized 
with the related content presentation at the external device which includes functionality 
for providing audio related to the show (see, e.g., page 2, paragraph [0015]); and 

the external device can provide multidimensional movement (see, e.g., page 3, 
paragraph [0025], lines 9-14). 

It would have been obvious for one of ordinary skill in the art at the time of the 
invention to combine Boudreau with Zweig in view of Yamada in order to increase the 
level of interest in the television show by presenting the content of the television show 
on an external device such as a toy and a doll. 

Regarding claims 2 and 10, Zweig teaches as follows: 

means for storing said downloaded high level program instructions (CGI 
commands are passed through CGI interface to other program in the robot's onboard 
memory, see, e.g., col. 10, lines 28-36); and 

means for retrieving said downloaded high level program instructions (CGI 
commands) from said storing means (robot's onboard memory)(run these other 
program passed from CGI commands as needed, see, e.g., col. 10 , lines 28-36). 

Regarding claim 3, Zweig teaches as follows: 

means for rendering pre-stored high level program instructions (processed 
instructions or previously assigned set of commands) pre-stored on one or more 
computer-readable media (robot's onboard memory) coupled to or integrated with said 
robotic web browser (standing orders are to modify the state of the robot without 
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requesting furtlier input from remote internet site, tiie robot activates a previously 
assigned set of commands to move out of the area, see, e.g., col. 1 1 , lines 30-40). 
Regarding claim 4, Zweig teaches as follows: 

a mobile robot (functioning as a web server) sends Hyper Text Markup Language 
files using the HTTP protocol on telecommunications link to a web browser running on 
remote Internet site (see, e.g., col. 9, lines 36-39); and 

a user on web browser sends CGI data to the CGI interface of the robot's 
onboard web server (see, e.g., col. 9, lines 39-42). 

Since Zweig teaches using a robot as a web server instead of web browser, it 
would have been obvious for one of ordinary skill in the art at the time of the invention to 
modify Zweig to alter the functionality of the robot from a web server to a web browser 
in order to manage a plurality of robotic web browsers with one dedicated web server 
and also to reduce the cost of making the robot. 

Regarding claim 5, Zweig teaches as follows: 

means for processing data in two-dimensions (displaying video) in accordance 
with current and future network browser standards (it is inherent functionality for any 

existing web browser, Java applets can translate user commands to other languages 
.display video, display interactive graphics and other useful functions, see, e.g., col. 2 , 
lines 43-50). 

Regarding claims 6 and 1 1 , Zweig teaches as follows: 

said electronic network is the Internet (see, e.g., col. 6, lines 65-67). 

Regarding claim 7, Zweig teaches as follows: 
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said program instructions are downloaded in accordance with a recognized 
Internet transmission protocol (HTTP and TCP/IP, see, e.g., col. 1 , line 65 to col. 2, line 
4). 

Regarding claims 8 and 12, Zweig teaches as follows: 

said electronic network is one of a wireless or wired network (Internet could be 
wireless or wired network, see, e.g., see, e.g., col. 6, lines 65-67). 

Regarding claim 9, Zweig teaches as follows: 

a system for executing high level language instructions (highest level 
commands), downloaded over an electronic network (Internet link)(see, e.g., col. 6, line 
65 to col. 7, line 6), said instructions for processing in a multi-dimensional 
robotic web browser (see, e.g., col. 7, line 7-8), the system comprising: 

at least one remote computer (remote Internet user, 4 in figure 1 ) for generating 
said high level language instructions (the remote Internet user sends back CGI 
commands requesting robotic movement back to server, see, e.g., col. 10, lines 50-56); 

said electronic network (telecommunications link, 3 in figure 1) coupling said at 
least one remote computer (remote Internet user, 4 in figure 1) with said multi- 
dimensional robotic web browser (mobile robot, 1 in figure 1)(see, e.g., col. 9, lines 34- 
39); 

said multi-dimensional robotic web browser (computerized mobile robot with an 
onboard Internet web server, see, e.g., abstract, lines 1-7), comprising: 

means for receiving said high level language instructions downloaded over said 
electronic network (the robot receives its most general highest level commands from the 
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remote Internet link, see, e.g., col. 6, lines 65-67); and 

means for rendering said downloaded high level language instructions (control 
instructions), such that when at least a portion of said instructions are rendered by said 
robotic web browser (interpret and modify these top-level commands in a quick and 
real-time manner, see, e.g., col. 7, lines 1-6), direct said robotic web browser to move in 
three-dimensions (a robot may be given a remote command over the Internet to move 
forward a number of feet, see, e.g., col. 7, lines 7-8). 

Zweig does not teach the web browser included in the robot but teaches a 
computerized mobile robot with an onboard internet web server (see, e.g., abstract, 
lines 1-2). 

It would have been obvious for one of ordinary skill in the art at the time of the 
invention to modify Zweig to alter the functionality of the robot from a web server to a 
web browser in order to manage a plurality of robotic web browsers with one dedicated 
web server and also to reduce the cost of making the robot. 

Yamada teaches as follows: 

a robot including a web browser (connecting the electronic toy (equivalent to 
applicant's robot) to a network through a connection means includes a personal 
computer, see, e.g., page 4, paragraph [0067]-[0071], connecting the communication 
interface of the robot with the personal computer connected to the Internet, see, e.g., 
page 15, paragraph [0287]-[0288]); 

direct said robotic web browser to move in three dimensions (movement 
mechanism, see, e.g., page 1, paragraph [0012] and page 2, paragraph [0026]), play 


Application/Control Number: 10/539,904 Page 1 1 

Art Unit: 2454 

back an audio stream (sound data is downloaded with the connection means, see, e.g., 
page 4, paragraph [0067], outputting the downloaded sound data as a voice by the 
vocalization means, see, e.g., page 2, paragraph [0053]), and play back a video stream 
(display unit displays information, see, e.g., page 9, paragraph [0219], attached sound 
file is played, see, e.g., page 17, paragraph [0314]); and 

the robot is configured to move synchronously with content being rendered by a 
rendering device other than the robot (the electronic toy controlled so as to react to 
external information, see, e.g., page 2, paragraph [0032], making the robot move in 
correspondence with music or sound collected by a microphone, see, e.g., page 19, 
paragraph [0330]-[0331]). 

It would have been obvious for one of ordinary skill in the art at the time of the 
invention to modify Zweig to include multi functional robot as taught by Yamada in order 
to be utilized the robot as an adult toy performing various operations. 

Since Yamada teaches a display unit and the capability to run the downloaded 
sound file, it would have been obvious for one of ordinary skill in the art at the time of 
the invention to modify Yamada to include video stream play back function. 

Zweig does not teach of producing behaviors and interactions based on user 
preferences stored in a memory of the robot. 

Yamada teaches as follows: 

an emotion parameter (equivalent to applicant's user preference) is set based on 
the specific person (an emotion parameter is included in the control parameter, and the 
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emotion parameter is represented as the biorhythm of a specific person, see, e.g., page 
3, paragraph [0045]); 

producing behaviors and interactions based on the emotion parameter (control 
unit selects the information to be externally displayed and/or selects the sound to be 
externally output based on the emotion parameter, see, e.g., page 3, paragraph [0049]); 
and 

the electronic toy comprises a connection means for connecting the electronic 
toy to a network, and wherein at least one of the words and sound data is downloaded 
to the storage means (equivalent to applicant's robot memory) from a server device 
connected to the network (see, e.g., page 4, paragraph [0067]). 

It would have been obvious for one of ordinary skill in the art at the time of the 
invention to modify the emotion parameter to the user preference in order to display the 
received instruction or data in terms of the user's emotional status was previously 
stored. 

Therefore, Yamada teaches of rendering produce behaviors and interactions 
based on user preferences stored in a memory of the robot. 

It would have been obvious for one of ordinary skill in the art at the time of the 
Invention to modify Zweig to Include the emotion parameter as taught by Yamada In 
order to select different outputs means for the downloaded data through the network 
based on the emotion parameter was set based on a specific person. 

Zweig in view of Yamada teach the multidimensional robot produces behaviors 
based on a rendering device as presented above. 
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Zweig in view of Yamada do not teach that the rendering device is a television 
and producing behaviors and interactions based on a television show. 
Boudreau teaches as follows: 

a multi-media system includes functionality that provides for the download of 
content, including video. Audio, and/or data corresponding to television show episodes, 
that is related to the content presented on a television (the television is a well-known 
rendering device), and its corresponding presentation at an external device (equivalent 
to applicant's robot)(see, e.g., page 1, paragraph [0014]); 

the presentation of content displayed on the television set can be synchronized 
with the related content presentation at the external device which includes functionality 
for providing audio related to the show (see, e.g., page 2, paragraph [0015]); and 

the external device can provide multidimensional movement (see, e.g., page 3, 
paragraph [0025], lines 9-14). 

It would have been obvious for one of ordinary skill in the art at the time of the 
invention to combine Boudreau with Zweig in view of Yamada in order to increase the 
level of interest in the television show by presenting the content of the television show 
on an external device such as a toy and a doll. 

Regarding claims 13-15 and 19, Yamada teaches as follows: 

the multi-dimensional robotic web browser is configured to blink twice, smile, and 
bow (the display unit expresses various expressions of the robot with corresponding 
sound and movement, see, e.g., page 13, paragraph [0264] and page 17, paragraph 
[0318]); 
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perform a country dance and shake hands (movement based on music, see, e.g., 
page 17, paragraph [0320]-[0321]); 

synchronized to move in accordance with a content being rendered by the robot 
(control unit controls the motors based on the operational control information and makes 
the robot perform operations corresponding to the message stored in the robot, see, 
e.g., page 17, paragraph [0314]); 

produce behaviors and interactions based on a story line of the content 
(interpreted as a message)(control unit controls the motors based on the operational 
control information and makes the robot perform operations corresponding to the 
message and text data may also be read, see, e.g., page 17, paragraph [0314]); and 

produce behaviors and interactions based on user preferences regarding 
rendering of data including pace of delivery, loudness of the rendering, and movements 
(series of movements of the robot by assembling control codes corresponding to the 
individual operations, see, e.g., page 17, paragraph [0314] and the robot comprises as 
means for detecting the peripheral situation and inputs, a touch sensor, sound sensor, 
light sensor and status sensor to correspond for various interactions, see, e.g., page 9, 
paragraph [0218]. 

Therefore, they are rejected for similar reason as presented above in claims 1 

and 9. 

Regarding claim 21 , Yamada teaches as follows: 

the multi-dimensional robotic web browser is configured to blink twice, smile, and 
bow (the display unit expresses various expressions of the robot with corresponding 
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sound and movement, see, e.g., page 13, paragraph [0264] and page 17, paragraph 
[0318]); 

perform a country dance and shake hands (movement based on music, see, e.g., 
page 17, paragraph [0320]-[0321]); and 

control unit controls the motors based on the operational control information and 
makes the robot perform operations corresponding to the message and text data may 
also be read (see, e.g., page 17, paragraph [0314]). 

Therefore, it would have been obvious for one of ordinary skill in the art at the 
time of the invention to modify Yamada with Zweig in view of Boudreau to include the 
sequence of operations sequentially including performing a dance, blinking twice, 
smiling, bowing and shaking hands in order to increase the level of interest by adding 
more functionalities to the multi-dimensional robot web browser. 

Conclusion 

5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JEONG S. PARK whose telephone number is (571 )270- 
1597. The examiner can normally be reached on Monday through Friday 7:00 - 3:30 
EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Nathan Flynn can be reached on 571-272-1915. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 


/J. S. P./ 

Examiner, Art Unit 2454 

April 8, 2009 
/Nathan J. Flynn/ 

Supervisory Patent Examiner, Art Unit 2454 


